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Abstract. The Tikhonov-Phillips method is widely used for regularizing ill-posed 
inverse problems mainly due to the simplicity of its formulation as an optimization 
problem. The use of different penalizers in the functionals associated to the 
corresponding optimization problems has originated a variety other methods which 
can be considered as "variants" of the traditional Tikhonov-Phillips method of order 
zero. Such is the case for instance of the Tikhonov-Phillips method of order one, the 
total variation regularization method, etc. In this article we find sufficient conditions on 
the penalizers in generalized Tikhonov-Phillips functionals which guarantee existence 
and uniqueness and stability of the minimizers. The particular cases in which the 
penalizers are given by the bounded variation norm, by powers of seminorms and by 
linear combinations of powers of seminorms associated to closed operators, are studied. 
Several examples are presented and a few results on image restoration are shown. 
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1. Introduction 

In a quite general framework an inverse problem can be formulated as the need for 
determining x in an equation of the form 



where T is a linear bounded operator between two infinite dimensional Hilbert spaces 
X and Y (in general these will be function spaces), the range of T, TZ(T), is non-closed 
and y is the data, supposed to be known, perhaps with a certain degree of error. It 
is well known that under these hypotheses, problem ([1]) is ill-posed in the sense of 
Hadamard ([llj). In this case the ill-posedness is a result of the unboundedness of T\ 
the Moore-Penrose generalized inverse of T. The Moore-Penrose generalized inverse is 
a fundamental tool in the treatment of inverse ill-posed problems and their regularized 
solutions, mainly due to the fact that this operator is strongly related to the least- 
squares solutions of problem ([1]). In fact, the least-squares solution of minimum norm 
of problem (CQ), also known as the best approximate solution, is x* = T^y, which exists 
if and only if y e X>(T f ) = 1Z(T) © TZ{T) L . Moreover, for y e V(T*), the set of all 
least-squares solutions of problem <^ is given by +Af(T), where Af(T) denotes the 
null space of the operator T. 

The unboundedness of has as undesired consequence the fact that small 
errors or noise in the data y can result in arbitrarily large errors in the 
corresponding approximated solutions (see [18], [H]), turning unstable all standard 
numerical approximation methods, making them unsuitable for most applications and 
inappropriate from any practical point of view. The so called "regularization methods" 
are mathematical tools designed to restore stability to the inversion process and consist 
essentially of parametric families of continuous linear operators approximating T\ The 
mathematical theory of regularization methods is very wide (a comprehensive treatise 
on the subject can be found in the book by Engl, Hanke and Neubauer, [9]) and it is of 
great interest in a broad variety of applications in many areas such as Medicine, Physics, 
Geology, Geophysics, Biology, image restaurarion and processing, etc. 

There exist numerous ways of regularizing an ill-posed inverse problem. Among 
the most standard and traditional methods we mention the Tikhonov-Phillips method 
([15]. [T9] . [20]). truncated singular value decomposition (TSVD), Showalter's method, 
total variation regularization Qlj), etc. Among all regularization methods, probably the 
best known and most commonly and widely used is the Tikhonov-Phillips regularization 
method, which was originally proposed by Tikhonov and Phillips in 1962 and 1963 (see 
|15j . [19], [20]). Although this method can be formalized within a very general framework 
by means of spectral theory ([9], [?]), the widespread of its use is undoubtedly due to 
the fact that it can also be formulated in a very simple way as an optimization problem. 
In fact, the regularized solution of problem (JI|) obtained by applying Tikhonov-Phillips 
method is the minimizer x a of the functional 



Tx = y 



(1) 



J a (x) = \\Tx — y\\ 2 + a \\x 



(2) 
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where a is a positive constant known as the regularization parameter. 

The penalizing term a \\x\\ 2 in fl2]) not only induces stability but it also determines 
certain regularity properties of the approximating regularized solutions x a and of the 
corresponding least-squares solution which they approximate as a — > + . Thus, 
for instance, it is well known that minimizers of ([2]) are always "smooth" and, for 
a — > + , they approximate the least-squares solution of minimum norm of ([I]), 
that is lim a _ i> o+ x a — T^y. This method is more precisely known as the Tikhonov- 
Phillips method of order zero. Choosing other penalizing terms gives rise to different 
approximations with different properties, approximating different least-squares solutions 
of (OQ). Thus, for instance, the use of || V x l| 2 as penalizer instead of ||z|| 2 in (T5]) originates 
the so called Tikhonov-Phillips method of order one, the penalizer ||a:|| BV (where ||-|| BV 
denotes the bounded variation norm) gives rise to the so called bounded variation 
regularization method introduced by Acar and Vogel in 1994 ([I]), etc. In particular, in 
the latter case, the approximating solutions are only forced to be of bounded variation 
rather than smooth and they approximate, for a — > + , the least-squares solution of 
problem (TjQ) of minimum ||-|| BV -norm (see [1]). This method has been proved to be a 
good choice, for instance, in certain image restoration problems in which it is highly 
desirable to detect and preserve sharp edges and discontinuities of the original image. 

Hence, the penalizing term in (T5]) is used not only to stabilize the inversion of 
the ill-posed problem but also to enforce certain characteristics on the approximating 
solutions and on the particular limiting least-squares solution that they approximate. 
As a consequence, it is reasonable to assume that an adequate choice of the penalizing 
term, based on a-priori knowledge about certain characteristics of the exact solution of 
problem (TjQ), will lead to approximated "regularized" solutions which will appropriately 
reflect those characteristics. 

With the above considerations in mind, we shall consider functionals of the form 

Jw, a {x) = \\Tx — y\\ 2 + aW(x) x 6 V, (3) 

where W(-) is an arbitrary functional with domain T> d X and a is a positive constant. 

The purpose of this article is to find sufficient conditions on the penalizers in 
generalized Tikhonov-Phillips functionals of the form (J3j) which guarantee existence 
and uniqueness and stability of the minimizers. The particular cases in which the 
penalizers are given by the bounded variation norm, by powers of seminorms and by 
linear combinations of powers of seminorms associated to closed operators, are studied. 
Several examples are presented and a few results on image restoration are shown. 

2. Existence and uniqueness for general penalizing terms 

In this section we shall consider the problem of finding conditions on the penalizer W(-) 
which guarantee existence and uniqueness of global minimizers of (J3j). Previously we 
will need to introduce a few definitions. 
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Definition 2.1. Let X be a vector space, W a functional defined over a set T> C X and 

A a subset of T>. We say that A is W -bounded if there exists a constant k < oo such 
that \ W(a)\ < k for every a £ A. 

Definition 2.2. (W-coercivity) Let X be a vector space and W, F two functionals 
defined on a set T> C X . We say that the functional F is W -coercive if lim F(x n ) = +oo 



for every sequence {x n } C V for which lim^oo W(x n ) = +oo. 

Remark 2.3. Note that if the functional F is W -coercive and W is bounded from below, 
then all lower level sets for F, i.e. all sets of the form {x ET> : F(x) < a} with a G H 
are W -bounded sets. 

Definition 2.4. Let X be a normed vector space, W , F two functionals with Dom(F) C 
Dom(W) C X . We say that F is W -subsequentially (weakly) lower semicontinuous if 

for every W -bounded sequence {x n } C Dom(F) such that x n ^ x G Dom(F), there 
exists a subsequence {x nj } C {x n } such that F(x) < liminf^oo F(x n ,). If F is W- 
sub sequentially lower semicontinuous we will simply say that F is W-sls. Similarly, if 
F is W -subsequentially weakly lower semicontinuous we will say that F is W-swls. 

In the following theorem, sufficient conditions on the operator T and on the 
functional W guaranteeing the existence and uniqueness of the minimizer of the 
functional (j3J) are established. 

Theorem 2.5. (Existence and uniqueness) Let X, y be normed vector spaces, T G 
C(X,y), y G y, V C X a convex set and W : V — > R a functional bounded from 
below, W -subsequentially weakly lower semicontinuous, and such that W -bounded sets 
are relatively weakly compact in X . More precisely, suppose that W satisfies the following 
hypotheses: 

• (HI): 3 7 > such that W(x) > -7 Vi G V. 

• (H2): for every W -bounded sequence {x n } C V such that x n — >■ x G V, there exists 
a subsequence {x nj } C {x n } such that W(x) < Hminf^oo W(x nj ). 

• (H3): for every W -bounded sequence {x n } C V there exist a subsequence {x nj } C 
{x n } and x G T> such that x nj x. 

Then the functional Jw,a{~) i n 13) ^as a global minimizer. If moreover W is convex and 
T is injective or W is strictly convex, then such a minimizer is unique. 

Proof. First we note that for every sequence {z n } C T> we have that 



This follows immediately from the continuity of T and the weak lower semicontinuity 
of the norm. 

Let now {x n } C T> be such that 




(4) 



Jw,a{Xn) ^ hlf Jw,a\%) — J\ 



mm- 



(5) 
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Hypothesis (HI) guarantees that — oo < J min < +00. From the definition of J w>a {-) 
and since a > it follows that J Wta (-) is VF-coercive. Suppose now that the sequence 
{x n } is not W-bounded. Then, there exists a subsequence {x n . } C {x n } such that 
W(x n .) —> 00, from which, by virtue of the M^-coercivity of J WiCt (-) it follows that 
Jw,a( x nj) 00. This contradicts ([5]). Thus the sequence {x n } is VF-bounded. It then 
follows by hypothesis (HS) that there must exist a sequence {x nj } C {x n } and x e V 
such that x nj — >■ 2 and since W satisfies there exists a subsequence {i„ Jt } of {x nj } 
such that 



Then 



< Hminf W(x n . 



(6) 



\Tx-y\\ 2 + aW(x) 



< liminf 

k—^00 

< liminf 

k— >oo 



Tx njk - y 



+ a liminf W(x n . 

k— >oo Jk ' 



T x r 



'3k 



liminf J w , a (x nn ' 
lim Jw,a{j^n 

n— >oo 
Jm\r\ ' 



(by gD and ©) 

(by prop, of liminf) 
(by def. of J w>a ) 
(by (JSJ) and since {x njk \ is a subseq. of {x n }) 



+ aW{x njk 



It then follows that J w , a (%) — Jmm- This proves the existence of a global minimizer of 
03]). For the uniqueness, note that under the hypothesis that W be convex and T be 
injective or W be strictly convex, one has that the functional J w>a {-) is strictly convex 
and therefore the global minimizer is unique. ■ 



Remark 2.6. Note that in the previous theorem the convexity of T> is not needed for 
the existence. Note also that if we replace hypotheses (H2) and (H3) on the functional 
W by the assumptions that W be W-sls and that W -bounded sets be relatively compact 
in X , i.e. by the following hypotheses: 

• (H2 ? ): for every W -bounded sequence {x n } C V such that x n — > x G V, there exists 
a subsequence {x n ,} C {x n } such that W(x) < liminfj_ i , 00 W(x nj ); 

• (H3 ? ): for every W-bounded sequence {x n } C V there exist a subsequence {x n .} C 
{x n } and 16D such that x n . — > x, 

then both existence and uniqueness remain valid. 



Remark 2.7. Note that hypothesis (H3 7 ) is stronger than (H3) which, in turn, is 
stronger than the hypothesis that every W-bounded set be weakly precompact. Also, 
(H2 7 ) is weaker than (H2) which in turn is weaker than the hypothesis that W be weakly 
lower semicontinuous. 
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Remark 2.8. If X is a reflexive Banach space and W(-) is a norm defined on a subspace 
T> of X, which is on D equivalent or stronger that the norm of X , then it follows that 
W satisfies hypothesis (HI), (H2), (H3) and therefore the functional $3\) has a global 
minimizer on T>. If moreover T is infective or the normed space (T>, W(-) ) is complete 
and separable or Hilbert, then such a minimizer is unique. 

Observe that hypothesis (HI), (H2) and (H3) as well as (H2 7 ) and (H3') impose 
conditions only on the penalizer W(-) and not on T, so that the corresponding existence 
and uniqueness results hold for any bounded linear operator T. It is therefore not 
surprising that those conditions can be relaxed if some information on T in connection 
to W(-) is provided. The next theorem shows a result in this direction. 

Theorem 2.9. Let X, y be normed spaces, T G C(X,y), T> C X a convex set and W 
a real functional on T>. Consider the following standing hypotheses: 

• (12): W is T-W-swls, i.e for every sequence {x n } C V such that {||Ta; n || + W(x n )} 
is bounded inM. (in the sequel we shall refer to such a sequence as a 'T-W bounded 
sequence") and x n — )■ x G V, there exists a subsequence {x nj } C {x n } such that 
W(x) < liminf W(x n .). 

• (13): T-W -bounded sets are relatively weakly compact in X , i.e., for every T-W- 
bounded sequence {x n } C V there exist a subsequence {x nj } C {x n } and x G V 
such that x n . — >■ x. 

IfT and W(-) satisfy the hypotheses (HI), (12) and (13), then the functional Jw,a{-) in 
|3j] has a global minimizer. If moreover W is convex and T is injective or W is strictly 
convex, then such a minimizer is unique. 

Proof. Let {x n } be a minimizing sequence of J w>ol (-). From the definition of Jw,a(-) h 
follows that {x n } is T-W^-bounded. Then by (13) there must exist {x Uj } C {x n } and 
x E V such that x n . — > x. Now by virtue of (12) there exists {x njk } C {x nj } such 
that W(x) < liminf/ c _> 00 W(x njk ). Following now the same steps as in Theorem 12.51 we 
obtain that 

Jwa\*E) — min J\v a ( x ) . 

xev 

If W is convex and T is injective or W(-) is strictly convex, uniqueness follows from the 
strict convexity of J w , a (-) on V. ■ 

Remark 2.10. Note that hypotheses (12) and (13) are weaker that (H2) and (H3), 
respectively. Also note that both (12) and (13) hold, for instance if X is reflexive, W(-) 
is subsequentially weakly lower semicontinuous and T and W are complemented, i.e. 
there exists a positive constant c such that ||Tx|| 2 + W(x) > c \\x\\ 2 Vx G V. 

Remark 2.11. Just like in Theorem \2.5L in Theorem \2.9\, the convexity of T> is not 
needed for the existence. Also note that if hypothesis (12) and (13) are replaced by the 
assumption that W be T-W-sls and that T-W -bounded sets be relatively compact in X , 
i.e. by the hypoteses: 
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• (12'): for every T -W -bounded sequence {x n } C V such that x n — > x G V, there 
exists a subsequence {x nj } C {x n } such that W(x) < ]hxiiafj- > . 00 W(x nj )\ 

• (13'): for every T-W-bounded sequence {x n } C T> there exist a subsequence 
{x n ,} C {x n } and x G V such that x n . — > x, 

then the results of Theorem \2.9\ remain valid. 
3. Stability 

As it was previously mentioned, inverse ill-posed problems appear in a wide variety 
of applications in diverse areas. Solving these problems usually involves several steps 
starting from modeling, through measurements and data acquisition for the experiment 
under study, to the discretization of the mathematical model and the derivation of 
numerical approximations for the regularized solutions. All these steps entail intrinsic 
errors, many of which are unavoidable. For this reason, in the context of the study 
of inverse ill-posed problems from the optic of Tikhonov-Phillips methods with general 
penalizing terms, it is of particular interest to analyze the stability of the minimizers of 
the functional (j3J) under different types of perturbations. To proceed with some results 
in this direction we shall need the following definitions. 

Definition 3.1. (W -coercivity) Let X be a vector space, W, F n , n = 1, 2, . . ., Junctionals 
defined on a set T> C X . We will say that the sequence {F n } is W -coercive ij 
lim^oo F n (x n ) = +oo for every sequence {x n } C V for which lim^^ W(x n ) = +oo. 

Definition 3.2. (consistency) Let X be a vector space and W,F,F n ,n = 1,2,..., 
functionals defined on a set V C X . We will say that the sequence {F n } is consistent 
for F if F n x — > Fx for every x G T>. We will say that the sequence {F n } is W -uniformly 
consistent for F if F n x — > Fx uniformly on every W -bounded set, that is if for any given 
c > and e > 0, there exists N = N(c, e) such that \F n (x) — F(x)\ < e for every n> N 
and every x G V such that \W{x)\ < c. 

In the following theorem we present a weak stability result for the minimizers of a 
general functional on a normed space. 

Theorem 3.3. Let X be a normed vector space, T> a subset of X , W : D — > M. a 
functional satisfying the hypotheses (HI) and (H3) of Theorem \2. 51 (i.e. there exists 
7 > such that W(x) > —7 for every x G T> and every W -bounded sequence contains 
a weakly convergent subsequence with limit in T>), J, J n , n = 1,2, ... , functionals on 
T> such that J is W-swls and {J n } is W -coercive and W -uniformly consistent for J. 
Assume further that there exists a unique global minimizer x G T> oj J and that each 
Junctional J n also possesses onV> a global minimizer x n (not necessarily unique). Then 

w _ 
Xfi ^ X • 
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Proof. Since for each n G N, x n minimizes the functional J n we have that J n (x n ) < 
J n (x). Then 

limsup J n (x n ) < limsup J n {x) = J{x) < oo, (7) 

where the equality follows from the hypothesis that the sequence {J n } is W- uniformly 
consistent for J. From (J7J), the hypothesis (HI) on W and the hypothesis of W- 
coercitivity of {J n } it then follows that the sequence {x n } is iy-bounded. 

Suppose now that the sequence {x n } does not converge weakly to x. Then there 
exists a subsequence {x n . } of {x n } such that no subsequence {x nj } of {x nj } converges 
weakly to x. On the other hand, since the sequence {x nj j is W-bounded (since the 
original sequence is) hypothesis (H3) on W implies that there exist x* G T> and a 
subsequence \x n \ of {x n . \ such that x n . x*. It then follows that x* ^ x. 

On the other hand, since the sequence {x njk } is VF-bounded, x njk — > x* and J is 
W-swh, it follows that there exists a subsequence {x njk } C {x njk } such that 

J(x*) < liminf jfx n . V (8) 

Also, since the sequence {a; n . } is W-bounded and {J n } is VF-uniformly consistent for 
J, it follows that 



£->oc 



!™ (•M-'V ) ' - 7 " K. )) (9) 



Hence 



J(x*) < liminf J (x n . ) (by 
< lim sup J ( x T 



lim sup 



< limsup (J (x^) - (x njk( )) + limsup J n ^ (x n . 

= & ( J ) - ) ) + ^ ) ( by ® ) 

= limsu P J n ) (by©) 

< J(x). (by (|ZJ), since {x n } C {x n }) 

Since x is the unique minimizer of J it follows that x* = x, contradicting our previous 
result that x* ^ x. This contradiction came from assuming that the sequence {x n } did 
not converge weakly to x. Hence x n — >■ x as we wanted to show. ■ 



Note that by virtue of Remark 12.71 the hypothesis that J be H^-swls in the previous 
theorem can be replaced by the hypothesis that J be weakly lower semicontinuous on 
V. 
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In the particular case in which the functional J and J n are of Tikhonov-Phillips 
type, under certain general conditions on the penalizer W(-), the previous theorem 
yields a weak stability result for the minimizers of the functional ([3]). In fact we have 
the following corollary. 

Corollary 3.4. Let X be a normed vector space, y an inner product space, T, T n e 
C(X, y), n = 1, 2, • • y 6 y, a > 0, V a subset of X , W : V — > R a functional satisfying 
hypotheses (HI), (H2) and (H3) of Theorem \2.5\ J,J n ,n = 1,2,..., functionals on D 
defined as follows: 

J(x) = \\Tx-y\\ 2 + aW(x), (10) 
J n (x) = \\T n x - y n \\ 2 + a n W(x), (11) 

such that as n — > oo, a n — >■ a, y n — )■ y and T n x — > Tx uniformly for x in W -bounded 
sets (i.e. {T n } is W -uniformly consistent for T ) . Suppose further that J has a unique 
global minimizer x. If x n is a global minimizer of J n then x n x. 

Proof. To prove this corollary it suffices to verify that the functionals J and J n satisfy 
the hypotheses of Theorem 13.31 that is, verify that J is VF-swls and that the sequence 
{J n } is VF-coercive and P^-uniformly consistent for J. 

To prove that J is VT-swls, let {x n } C V be a VF-bounded sequence such that 
x n — V x G T>. From the continuity of T and the weak lower semicontinuity of every 
norm, it follow immediately that 

\\Tx — y\\ 2 < liminf \\Tx n — y\\ 2 . (12) 

n— >oo 

On the other hand, by (H2) it follows that there exists a subsequence {x nj } C {x n } 
such that 

W{x) < liminf W{x n ). (13) 



Then, 



J(x) = \\Tx -y\\ 2 + aW(x) 

< liminf \\Tx n . - y\\ 2 + liminf aW(x n .)(by $2ft y 

j— >oo j—too 

< \immi{\\Tx n — y\\ 2 + aW(x n .)} (by property of liminf) 

j—>oo 3 3 

= liminf J(x n .). 

Hence J is VT-swls. 

Now we will prove that the sequence {J n } is VF-coercive. For that let {x n } C V 
such that W(x n ) — > +oo. Observe that 

Jn{x n ) = \\T n x n - y n \\ 2 + a n W{x n ) > a n W{x n ). (14) 

Since W satisfies (HI) and a n — > a > 0, it follows immediately from ( |T4l) that 
J n { x n) — >• +oo. Hence { J n } is uniformly VT-coercive. 
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Finally we will show that {J n } is W^-uniformly consistent for J. For that let M C T> 
be a VF-bounded set. Since {T n } is VF-uniformly consistent for T we have that T n x — > Tx 
uniformly on M and since y n — > y, it follows that \\T n x — y n \\ 2 — > \\Tx — y\\ 2 uniformly 
on M. Finally, since 

\J n {x) - J(x)\ = | \\T n x - y n \\ 2 + a n W(x) - \\Tx - y\\ 2 - aW(x)\ 

< I ||T n x - y n \\ 2 - \\Tx - y\\ 2 \ + \{a n - a)\ \W(x)\, (15) 

it follows that J n (x) — > J(x) uniformly for x £ M. Thus {J n } is W^-uniformly consistent 
for J. 

Since J and {J n } satisfy the hypotheses of Theorem 13.31 the corollary then 
follows. ■ 

Remark 3.5. Note that by virtue of Remark 1 2. 81 the weak stability result of Corollary 
\3.4\ holds if i) X is a reflexive Banach space, ii) the penalizer W(-) in /[Tty) is a norm 
defined on a subspace V of X which is on V equivalent or stronger than the original 
norm in X and Hi) T is infective or the space (V, W(-) ) is a separable Banach space or 
a Hilbert space. 

Hypotheses on Theorem 13.31 and Corollary 13.41 can be weakened if adequate 
information on the operator T is available. Before we proceed to the statements of 
the corresponding results, we shall need the following definitions. 

Definition 3.6. (T-W -coercivity) Let X, y be vector spaces, T £ C(X,y), W, 
F n , n = 1,2, ... , functionals defined on a set T> C X. We will say that the sequence 
{F n } is T-W -coercive i/lim^oo F n (x n ) = +oo for every sequence {x n } C V for which 

limn— s-oo 

||Tx n || + W(x n ) = +oo. 

Definition 3.7. (T-W -uniform consistency) Let X, y be vector spaces, T £ C(X,y) 
and W, F, F n ,n = 1,2,..., functionals defined on a set T> C X. We will say that the 
sequence {F n } is T-W -uniformly consistent for F if F n — >■ F uniformly on every T-W- 
bounded set, that is if for any given c > and e > 0, there exists N = N(c, e) such that 
\F n (x) — F(x)\ < e for every n> N and every x £ T> such that ||Tx|| + |W(x)| < c. 

Theorem 3.8. Let X, y be normed vector spaces, T £ C(X,y), T> a subset of X, 
W : T> — > R a functional satisfying hypotheses (HI) of Theorem \2.5\ and (13) of 
Theorem \2.9\ (i.e. there exists 7 > such that W(x) > —7 for every x £ T> and 
every T-W -bounded sequence contains a weakly convergent subsequence with limit in 
D), J, J n , n = 1,2, ... , functionals on T> such that J is T-W-swls and {J n } is T-W- 
coercive and T -W -uniformly consistent for J. Assume further that there exists a unique 
global minimizer x £ T> of J and that each functional J n also possesses on V a global 
minimizer x n (not necessarily unique). Then x n — >■ x. 



Proof. The proof follows like in Theorem 13.31 with the obvious modifications. ■ 



Solutions of generalized Tikhonov- Phillips junctionals 



11 



Corollary 3.9. Let X be normed vector space, y an inner product space, T, T n G 
C(X, y), n = 1, 2, ■ • - ; y G y, a > 0, V a subset of X , W : V — > R a functional satisfying 
hypotheses (HI) of Theorem \2.5\ and (12) and (13) of Theorem \2.9\ J,J n ,n = 1,2,..., 
functionals on T> defined as follows: 

J(x) = \\Tx-y\\ 2 + aW{x), 
J n (x) = \\T n x - y n \\ 2 + a n W(x), 

such that as n — > oo, a n — >■ a, y n — )■ y and T n x — > Tx uniformly for x in W -bounded 
sets (i.e. {T n } is W -uniformly consistent for T ) . Suppose further that J has a unique 
global minimizer x. If x n is a global minimizer of J n then x n A x. 

Proof. We will show that J and {</„} satisfy the hypotheses of Theorem 13. 81 For 
that it suffices to show that J is T-W-swls and that {J n } is T-W coercive and T- 
W- uniformly consistent for J. That J is T-W-swls follows immediately from (12) and 
the weak lower semicontinuity of every norm. The T-W^-uniform consistency of {J n } 
for J follows exactly as in the proof of Corollary 13.41 by noting that \J n (x) — J{x)\ < 
\\T n x — y n \\ 2 — \\Tx — y\\ 2 \ + \(a n — a) \ \W(x)\ and using the fact that T-VF-bounded 
sets are also H^-bounded. Finally, the T-iy-coercivity of {J n } follows easily from the 
W^-uniform consistency of {T n } for T. ■ 

Next we present a strong stability result for the minimizers of general functionals 
on a normed space. 

Theorem 3.10. Let X be a normed vector space, T> a subset of X , W : T> — > R a 
functional satisfying hypotheses (HI) of Theorem \2.5\ and (H3 ? ) of Remark \2.6i (i.e., 
there exists 7 > such that W(x) > —7 for every x G T> and every W -bounded sequence 
contains a convergent subsequence with limit in T>), J, J n , n = 1,2,..., functionals 
on T> such that J is W -subsequentially lower semicontinuous (W -sis) and {J n } is W- 
coercive and W -uniformly consistent for J. Suppose further that J has a unique global 
minimizer x G T> and that each functional J n also possesses onD a global minimizer x n 
(not necessarily unique). Then 

Proof. For each n G N, let x n be a global minimizer of J n . Following the same steps as 
those in the proof of Theorem 13.31 it follows that the sequence {x n } is VT-bounded. 

Suppose now that {x n } does not converge to x. Then there exists a subsequence 
{x nj } of {x n } such that no subsequence of {x nj } converges to x. On the other hand, 
since the sequence {x nj } is VF-bounded (since the original sequence is), hypothesis (H3') 

on the functional W implies that there exist a subsequence |# nj - fc j °f { x rij } an d x* G T> 
such that *. From this it follows that x* 7^ x and since J is W-sls, there exists 



a subsequence 





(16) 
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Then 

J(x*) < liminf J (x n . ) (by M§) 



< limsup 

l— >oo 



'n., V X "h u 



< limsup ( J (x nj ) - J njk (x n ) ) + limsup J nj 

= limsup J nj (x nj j (since {</„} is W-unif. consistent for J) 

< limsup J n (x n ) (since } C 

< limsup J n (x) (since x n minimizes J n ) 

= J(x). (since {«/„} is VF-unif. consistent for J) 

Hence J(x*) < J(x) which contradicts the fact that x ^ x* and x* is the unique 
minimizer of J. This contradiction came from assuming that the sequence {x n } does 
not converge to x. Hence x n — > x. ■ 

The previous theorem yields a strong stability result for minimizers of the functional 
([3]) in the particular case in which J and J n are of Tikhonov-Phillips type. More precisely 
we have the following corollary. 

Corollary 3.11. Let X be a normed vector space, y an inner product space, T, T n e 
C(X, y), n = 1, 2, • • - ; y 6 y, a > 0, V a subset of X , W : V — > M a functional satisfying 
hypotheses (HI) of Theorem \2.5\ and (H2 ) ) and (H3 ? ) of Remark \2.6] J,J n ,n = 1,2,..., 
functionals on T> defined as follows: 

J(x) = \\Tx-y\\ 2 + aW(x), (17) 
J n {x) = \\T n x-y n \\ 2 + a n W{x), (18) 

such that as n — > oo, a n — >■ a, y n — )■ y and T n x — > Tx uniformly on W -bounded sets 
(i.e. {T n } is W -uniformly consistent for T ) . Suppose further that J has a unique global 
minimizer x. If x n is a global minimizer of J n then x n — > x. 

Proof. Since the proof is immediately obtained from Theorem 13.101 following the same 
steps as in Corollary 13.41 we do not give details here. ■ 

Here again, the strong stability results of Theorem 13.101 and Corollary 13.111 remain 
valid under weaker hypotheses involving both the model operator T and the penalizer 
W. 

Theorem 3.12. Let X be a normed vector space, T> a subset of X , W : T> — > R 
a functional satisfying hypotheses (HI) of Theorem \2.5\ and (13') of Remark \2.11\ 
(i.e., there exists 7 > such that W(x) > —7 for every x G T> and every T-W- 
bounded sequence contains a convergent subsequence with limit inV), J, J n , n = 1, 2, . . . , 
functionals on T> such that J is T -W -sub sequentially lower semicontinuous (T-W-sls) 
and {J n } is T-W -coercive and T -W -uniformly consistent for J . Suppose further that J 
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has a unique global minimizer x G T> and that each functional J n also possesses onT> a 
global minimizer x n (not necessarily unique). Then 

Proof. The proof of this theorem proceeds exactly as the one of Theorem 13.101 by 
changing the jy-boundedness, VF-sls, W- uniform consistency and (H3') hypoteses by 
T-VT-boundedness, T-W-sh, T-W-waiiorm consistency and (13'), respectively. ■ 

Here again, the previous strong stability theorem yields a corresponding stability 
result for minimizers of the functional (j3J) in the particular case in which J and J n are 
of Tikhonov-Phillips type. This result is given in the following corollary. 

Corollary 3.13. Let X be a normed vector space, y an inner product space, T, T n G 
C(X, y), n = 1, 2, • • - ; y G y, a > 0, V a subset of X , W : V — > R a functional satisfying 
hypotheses (HI) of Theorem{2J\ and (12') and (13') of Remark \2JJl J,J n ,n = 1,2,..., 
functionals on T> defined as follows: 

J(x) = \\Tx-y\\ 2 + aW(x), (19) 
J n {x) = \\T n x - y n \\ 2 + a n W(x), (20) 

such that as n — > oo, a n — >■ a, y n — >■ y and T n x — > Tx uniformly on W -bounded sets 
(i.e. {T n } is W -uniformly consistent for T ) . Suppose further that J has a unique global 
minimizer x. If x n is a global minimizer of J n then x n — > x. 

Proof. We will show that J and {J n } satisfy the hypotheses of Theorem 13.121 For 
that it suffices to show that J is T-W-sh and that {J n } is T-W coercive and T- 
W^-uniformly consistent for J. The fact that J is T-W-s\s follows immediately from 
(12'), the boundedness of T and the continuity of the norm in X. The T-VF-uniform 
consistency of { J n } for J follows exactly as in the proof of Corollary 13.41 by noting 
that \J n (x) — J(x)\ < | \\T n x — y n \\ 2 — \\Tx — y\\ 2 \ + \(a n — a)\ \W(x)\ and using the 
fact that T-W-bounded sets are also M^-bounded and the hypothesis of the VF-uniform 
consistency of {T n } for T. Finally, also the T-iy-coercivity of { J n } follows easily from 
the W- uniform consistency of {T n } for T. ■ 

4. Particular cases 

In this section we present several examples of penalizers W(-) for which some of the 
results obtained in the previous section are valid and therefore, existence, uniqueness 
and/or stability for the minimizers of the corresponding generalized Tikhonov-Phillips 
functional J Wta (-) in (j3J) are obtained. 

4-1. Total variation penalization 

Bounded variation penalty methods have been studied by Rudin, Osher and Fatemi in 
1992 ([IS]) and Acar and Vogel in 1994 ([]]), among others. These methods have been 
proved highly successful in certain image denoising problems where edge preserving 
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is an important issue (jl], [5], [5], [S]). Let d > 2, Q C M. d & convex, bounded 
set with Lipschitz continuous boundary, 1 < p < -J^r, X = L P (Q), T> = BV (fl), 
where BV(Q) denotes the space of functions of bounded variations on Q. Recall that 
BV(Q) = {u G L 1 ^) : J (u) < oo}, where J (u) = sup v& jy J n (—udivv) dx and V = 
{v G C£(fi; R d ) : \v(x)\ <lViGfi} (for u G C 1 ^) one has that J (u) = J n \Vu\ dx) 
and for u G SV(fi) the BV norm of u is defined by |M| BV(n) = || i i (r2) + J (u). Let W 
be the functional defined on V by W{u) = \\u\\ BV(n) . 

We will show that W(-) satisfies the hypotheses (HI), (H2) and (H3) of Theorem 
12.51 Clearly W(-) satisfies hypothesis (HI) with 7 = 0. Hypothesis (HS) follows 
immediately from the compact imbedding of BV(Vl) into L p (f2) for 1 < p < -^r and 
from the weak compact imbedding for p = -^7. These results are extensions of the 
Rellich-Kondrachov Theorem and can be found for example in [2] and [3]. It only 
remains prove that W(-) satisfies hypothesis (H2). For that, let {u n } C V be a W- 

bounded sequence such that u n ^4 u G P. Then, u n w —^>- u (since p > 1). From the 
weak lower semicontinuity of the |Hlxi(n) norm an d of the functional J (') i n -^ x (^) (see 
[1]), it follows that 

INI^W) < liminf || u n || il( - n -, and J (u) < liminf J (u n ). (21) 

Then, 

< liminf || u n \\ Ll(m + liminf J (u n ) (by (EE])) 

< liminf ( ||« n || L i f m + J ( u n) J 
= liminf || ti„ || Bvm 

= liminf W(u n ), 

n— ¥00 

which proves (H2). Hence W{ ) satisfies the hypotheses of Theorem 12.51 and therefore 
for any a > 0, T G C(X, y), (y a normed space) the functional 

j \\-\\bv,<x( u ) = W Tu ~ V W 2 + a ll w IUv- ( f2) (22) 
has a global minimizer on BV(Q). If T is injective then such a global minimizer is 
unique. If T is not injective uniqueness cannot be guaranteed since the || ■ || S v-norm 
is not strictly convex. Also, if p < -j^t and J\\.\\ BV , a {') has a unique global minimizer, 
then the problem of finding such a minimizer is strongly stable under perturbations in 
the model (T), in the data (y) and in the regularization parameter (a). This follows 
immediately from the fact that (H2) is stronger than (H2'), the relative compactness of 
BV-bounded sets in L P (Q) for p < (see [TU]) and Corollary 13.111 For p = and 
d > 2 the problem is weakly stable, by virtue of Corollary 13.41 

4-2. Penalization with powers of semi-norms associated to closed operators 

Theorem 4.1. Let X, Z be reflexive Banach spaces, y a normed space, T G C(X,y) 
and L : T>(L) C X — >■ Z a closed linear operator such that the range of L, TZ(L), 
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is weakly closed. Assume further that T and L are complemented, i.e. there exists a 
constant k > such that \\Tx\\ 2 + ||-^x|| 2 > k \\x\\ 2 , V x G T>{L). Then, for any q > 1, 
a > and y e ^ #ie functional 

J Ltqia (x) = \\Tx-y\\ 2 + a\\Lx\\ q , xeV(L), (23) 

has a unique global minimizer. 

Proof. Let q > 1, Z> = X>(L) and W^,, : £> — ► M+ denned by W L , 9 {x) = \\Lx\\ q . We will 
show that T and W L , q satisfy the hypotheses (HI), (H2) and (IS). Hypothesis (HI) is 
trivially satisfied since W L>q (x) > V x G V. To prove that (H2) holds, let {x n } C V 
be a VV ii9 -bounded sequence such that x n — )■ a; G P. Then there exists a constant 
c < oo such that ||Lic n || < c V n G N. Since the Banach space Z is reflexive, there exist 
z G Z and {x nj . } C {x n } such that Lx„ 3 — > z. Since 7£(L) is weakly closed z G 1Z(L). 
Now, the operator L', the Moore- Penrose generalized inverse of L, is continuous (since 
TZ(L) is closed), and therefore P u ^±x nj = l)Lx n . — > V> ' z (where P M{L) ±_ is the 
orthogonal projection of X onto Af(L)- 1 -). Since x nj = P M(L) ±x n . + Pfj( L) x n] it follows 
that Pjv-(t)X n . — > x — lJz and therefore x — L^z G N(L) (since Af(L) is weakly closed, L 
being closed). Hence = L(x — Dz) = Lx — LL^z = Lx — P-^jz = Lx — z. Thus z = Lx 
and W L q (x) = \\Lx\\ q = \\z\\ q < lim infj^oo \\Lx n . \\ q = lim inf^oo W LtS (x n .), where the 
inequality follows from the fact that Lx n . — V z and the weak lower semicontinuity of 
the norm in Z. This proves (H2). 

To prove that (IS) holds, let {x n } C V be a T-W L ^-bounded sequence. By the 
complementation condition it follows that {x n } is bounded in X and by the reflexivity 
of X there must exist a subsequence {x nj } C {x n } and x G X such that x n . — > x. It 
only remains to be proved that x G T> = T>(L). For that observe that since {x nj } is a 
W^-bounded sequence such that x nj — > x, following the same steps as in the proof 
of (H2) above, we obtain that there exists z G H(L) such that x — L^z G J\f(L). Since 
L ] z G M{L) L C V(L) it then follows that x G V(L). This finally proves that (IS) holds. 

Now, since hypothesis (H2) implies hypothesis (12) (see Remark 12.101) . Theorem 
12.91 now implies that for any a > 0, y G y, the functional J Ligia (x) defined by fl23|) . has 
a global minimizer on T>(L). Since q > 1, from the complementation condition it follows 
easily that J Li9 , Q is strictly convex and therefore such a global minimizer is unique. ■ 

It is appropriate point out here that the above hypotheses on L are satisfied by 
most differential operators and that the complementation condition holds, for instance, 
whenever dimJ\f(L) < oo and N(T) HAf(L) = {0}. Also, the previous theorem provides 
existence for any q > 0. However uniqueness can only be guaranteed for q > 1 and, if 
T is injective, also for q = 1. 

The next Lemma shows that the problem of finding the global minimum of ( 1231) is 
weakly stable under perturbations on y, a and T. 
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Lemma 4.2. Let X, y, Z, T, L, V as in Theorem \4-l\ q > I, y, y n G y, a, ot n > 0, 
T n G £(X, y), n = 1,2, . . ., and J i>9iCt , J n , rz = 1,2, junctionals on V defined by 



Jh, q , a {x) = \\Tx — y\\ 2 + a \\Lx\\ q , (24) 
J n (x) = \\T n x - y n \\ 2 + a n \\Lx\\ q . (25) 

Assume that a n — >■ a , y n — >■ y as n — >• oo and that T n x — > Tx uniformly for x in L- 
bounded sets (i.e. {T n } is L-uniformly consistent for T ) . Let x be the unique minimizer 
of Jh, q , a and x n a global minimizer of J n . Then x n — >■ x. 

Proof. Let W L>q : T> — > defined by W L>q {x) = \\Lx\\ q . In Theorem 14.11 we proved 
that T and W L , q satisfy hypotheses (HI), (12) and (13). Since by hypothesis a n —> a, 
y n — >■ y and {T n } is W^^-uniformly consistent for T, the Lemma follows immediately 
from Corollary 13.91 ■ 

From the point of view of applications of the Tikhonov-Phillips methods, the weak 
stability result established by the previous Lemma, although important, could render 
insufficient. A strong stability result, at least on the data y is highly desired. In the next 
Lemma we show that such a result can be obtain by imposing an additional hypothesis 
to the operator L. 

Lemma 4.3. Let X, Z, y, T, T n L, V, q, W L>q , y, y n , a, a n , J l>g , a , x, x n and J n ,n = 



1,2, ... as in Lemma \4~l^ Assume further that T-L-bounded sets are compact in X . Then 

Proof. In Theorem 14.11 we proved that T and W L>q satisfy hypotheses (HI) and (12). 
Since hypothesis (12) implies hypothesis (12') and the compactness of T-L-bounded sets 
implies (13)', the lemma then follows from Corollary 13.131 ■ 

Remark 4.4. If q = 2, under the same hypotheses of Lemma 4-2 one can get continuity 
of the solutions of [2$ with respect to a and y. This can be easily verified from the fact 
that the unique global minimizer of (2~4\ ) is given by x = (aL*L + T*T)~ 1 T*y. Thus, if 
x n is the minimizer of UZD) with T n = T V ' n, then one has that 

x-x n = (a-a n ) (aL*L + T*T)~ l L*L x n +(aL*L + T*T) _1 T*(y-y n ).(26) 

Suppose now that a n — >■ a and y n — >■ y. Then by Lemma \4-2\ x n —f x and 
therefore {x n } is bounded. Also, since ||Tx|| 2 + ||Lx|| 2 > fc||x|| 2 it follows that the 
operators (aL*L + T*T) 1 L*L and (aL*L + T*T)~* T* are both bounded. In fact 
(aL*L + T*T)~ l L*L < a' x I and {aL*L + T*T)~ 1 < kn A iy Hence, it follows from 
l[2b)) that x n — > x. 
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4-3. Penalization by linear combination of powers of semi-norms associated to closed 
operators 

We study here the case of generalized Tikhonov-Phillips regularization methods for 
which the functional W(-) in ([3]) is of the form W(x) = Yli=i a i\\Li x \\ qi i where the Lj's 
are closed operators. We start with the main existence and uniqueness result. 

Theorem 4.5. Let X, Z\, Z 2 , . . . ,Zn be reflexive Banach spaces, y a normed space, 
T G C(X,y), V a subspace of X , Li : V — > Zi, i = 1,2,...,N, closed linear operators 
with TZ(Li) weakly closed for every 1 < i < N and such that T, L\, L 2 , . . . , Ln are 
complemented, i.e. there exists a constant k > such that \\Tx\\ 2 + YliLi ll-^ x ll 2 — 
/c||x|| 2 , Wx G V. Then, for any y G y, aj, a 2 , ■ ■ ■ , «at G M + and qi, q 2 , ■ ■ ■ ,qN G R, 
qi > 1 Vz = 1, 2, . . . , N, the functional 

N 

J{x) = \\Tx - yf + on \\Lix\\ qt , (27) 
i=i 

has a unique global minimizer. 

Proof. Let y G y, ati > 0, qi > 1, i — 1, 2, . . . , N and define a = (a\, a 2 , ... , «Ar) T , (f = 
(gi, g 2) • • • > ?aO T , the normed space iT = <S>f =1 Zi, L : ^ — > Z as = 
(Lix, L 2 x, . . . , Lnx) t , and the functional W^^. d : Z> — >■ by W^^x) = 

5^i=i a i ll-^i^ll 9 '; so that J(x) = ||Tx — y\\ 2 + W^^ s (x). We will prove that T and 
W L,q,s satisfy the hypotheses (^ffij, (H2) and (73/ In fact, (HI) is trivial and for (H2), 
let {x n } C D be a -.^.-bounded sequence such that G T>. Then for every 

i = 1, 2, . . . , N, the sequence {LjX™}^ is bounded in Zi and since Zi is reflexive there 
exist a subsequence {£n fe } and Zi G 2j such that LiX nk — )■ 2j as k — > oo. Since TZ(Li) 
is weakly closed, z$ G TZ(Li). By taken subsequences, we may assume that such a 
subsequence is the same for all i, i.e. LjX nfe — > Zi as — > oo for every z = 1, 2, . . . , iV. 

Now, since TZ(Li) is closed, £j is bounded and therefore L^L iX nk y L^Zi, as /c ^ oo, 
for all i = 1, 2, . . . , N. Since = Pj^r Li \x is the orthogonal projection of X onto 
A^Li)- 1 , writing x nk = P^ Li) ±x nk + P^ L .yx nk , it follows that P^ Li )X nk ^ x - Ljzi as 
k — > oo and therefore x — LjZi G N{Li) (being N(Lj) closed, since Lj is closed). Hence 
for alH = 1, 2, . . . , N, it follows that = Li(x — L\zj) = LiX — P n , L ,^ Zi = LiX — Zi (where 
the last equality follows since G LtiLi) )• Thus, = LiX Vz = 1, 2, . . . , N. Then 

\\Lix\\ q > = \\zi\\ gi < liminf HLiXnJ*, 

(where the last inequality follows from the fact that LiX nk — >■ as k — )■ oo and the weak 
lower semicontinuity of the norm in Zi), and therefore 

N N 

W E,q,s( x ) = ^2ai\\Lix\\ qi < ^ailirninf \\LiX nk \\ m 

i=l i=l " X 

N 

< liminf y^ ctiW LiX nk \\ qt = liminf W £ * g (x nk ). 

i=l 
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Thus (H2) holds. That (13) also holds follows from the complementation condition and 
the reflexivity of X, following the same steps as in Theorem 14. II Since (H2) implies (12), 
it now follows from Theorem 12 . 9 1 that the functional J(x) in ( 1271) has a global minimizer 
on T>. Moreover, since > 1 for all i, it follows from the complementation condition 
that «/(■) is strictly convex and therefore such a minimizer is unique. ■ 

Under the same hypotheses of Theorem 14.51 one has that the solution of (f2Tl) is 
weakly stable under perturbations in the data y, in the parameters ctj and in the model 
operator T. More precisely we have the following result. 

Lemma 4.6. Let all the hypotheses of Theorem \4-5\ hold. Let also y, y n E y, 
T n E C(X,y), n = 1,2,..., such that y n — > y, {T n } is L-uniformly consistent for 
T and for each i = 1, 2, . . . , N, let {a™}^ C M + such that af —> cti as n — > oo. If x n 
is a global minimizer of the functional 

N 

J n {x) = \\T n x-y n \\ 2 + J2 a 7\\Lix\\ qi , (28) 

i=i 



then x n — > x, where x is the unique minimizer of (21). 

Proof. Let W = - 5 as in Theorem 14.51 From the hypotheses it follows easily that 
{J n } is T-VF-coercive and W- uniformly consistent for J. 

Let x n be the unique minimizer of J n . Then J n (x n ) < J n (x), Vn. Therefore 

limsup J n (x n ) < limsup J n (x) = J(x) < oo, (29) 

where the equality follows from the W- uniform consistency of {J n } for J. But since 
{J n } is T-W-coercive it then follows that {x n } is T-H^-bounded. We claim that 
In fact, suppose that is not the case. Then, there exists a subsequence {x nj } C {x n } 
such that no subsequence of {x nj } converges weakly to x. But since {x nj } is T-W- 
bounded and X is reflexive, there exist x* ^ x and {x njk } C {x nj } such that x n .^ — > x*. 
Following the same steps as in Theorem 14.51 we obtain that there exists a subsequence 
{x n . } C {x n . } and Z{ E Z u % — 1, 2, . . . , N, such that LiX n . —fZi = L { x* as £ — > oo, 



Vi = l,2,...,iV, and 



t— >oo 



W(x*) < liminf W (x n . I. (30) 



Also, since {x njk } is IV-bounded and {J n } is VF-uniformly consistent for J, it follows 
that 



lim (J[x - J (x n ^ ) ) = 0. (31) 



Hence 



J(x*) = \\Tx* -y\\ 2 + W(x*) 

< liminf ||Tx n . — y\\ 2 + liminf W(x n . ) (by (130 



<limmf(||Tx„ Ji( -,f + inx,, l( )) 
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lim inf J \ x 

l— >oo 



-3k, 



< lim sup J ( x nj 
J I x n 



lim sup 



Jn 



3k, 



"3k, 



+ Jn 



Jk, 



X 7 



'Jk, 



< lim sup ( J ( x, 



= lim sup J r 

< J(x) 



■3k, 



J n 



"Ok, 



It 



+ lim sup J n . 



3k, 



■L I. 



3k, 



} C {x n } 



(by m) 

(by (J29]) since {x r 

kg 

Since x is the unique minimizer of J it would then follow that x* = x, contradicting our 
previous result that x* ^ x. This contradiction came from the assumption that x n did 
not converge weakly to x. Hence X r X, 



Lemma 4.7. Under the same hypotheses of Lemma \4-6} if T-L-bounded sets are compact 
in D, then strong stability holds, i.e., x n — > x. 



W? , ,. In Lemma 14.61 it 



Proof. Let x n denote the global minimizer of J n and W 
was proved that the sequence {x n } is T-PU-bounded. Suppose that x n -» x. Then 
there exists a subsequence {x nj } C {x n } such that no subsequence of {x n . } converges 
to x. But since {x nj } is T-W^-bounded, now by compactness hypothesis there must exist 
x* G V, x* x, and a subsequence {x n . } C {x n .} such that — > oo. 
Using the jy-uniform consistency of { J n } for J and following similar steps as in Lemma 
14.61 one obtains that J(x*) < J(x). Since x is the unique minimizer of J it would then 
follow that x* = x, contradicting our previous result that x* ^ x. Therefore we must 
have that x n — > x. ■ 

Remark 4.8. Here again, for the case qi = 2 Vi ; strong continuity of the solution 
of the functional J(x) in (Fl\ ) with respect to the data y and the parameters cti follow 
without any further hypotheses than those in Lemma \4-6\ This result follows easily 
from the fact that in such a case the unique global minimizer of (2l\ ) is given by 

x = ^T*T + £^=1 ctiL*Li^ T*y. Thus, if x n is the minimizer of (E2j) with T n = T Vn, 
then one has that 



N 



-1 



N 



x-x n = I T*T + ^ aiL* Li \ y^( a i ~ Qii)L*Li%n 



i=l 



1=1 



N 



(32) 



i=i 



Now, from the complementation condition ||Tx|| 2 
follows easily that 



£2=i ll L ^ll 2 > A:||a;]| 2 , Va: G V, it 



N 



-1 



0<[T*T + J2 <*iL*i L i < 



1 



t=i 



fcmin (1, mini<j<jv aA 



(33) 
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N 



N 



t*t + ®i L *i L i ) - aWih 



x 



< 



i I / /-J 

maxi<Kjv la" - a. 



miiiKKAf a, 
[/sing (34\ ) and l[33}) in [SJfy we obtain that 

maxi <i<N |af - a* 



I y* I 



millKKJV «j 



kmm (1, mini<i<Ar atij 



(34) 



\y-y n \\.(35) 



Now since by Lemma \4-6] x n — > x, it follows that {x n } is bounded. Since y n — > y and 
af — > ctj V« = 1, 2, . . . , iV ; as n — )■ oo ; it finally follows from < f^3)j t/iat x n — >■ x. 

5. Applications to Image Restoration 

The purpose of this section is to present an application to a simple image restoration 
problem. The main objective is to show how the choice of the penalizer in a generalized 
Tikhonov-Phillips functional can affect the reconstructed image. 

The basic mathematical model for image blurring is given by the following Fredholm 
integral equation 



Kf(x,y)= / / k(x,y,x',y')f(x',y')dx'dy' = g(x,y), 
J Jn 



(36) 



where Q C IR 2 is a bounded domain, / e X = L 2 (Q) represents the original image and 
k is the so called "point spread function" (PSF). For the examples shown below we used 
a PSF of "atmospheric turbulence" type 

k(x,y,x',y') = ^exp (-n\\(x,y) - (x',y')l| 2 ) , (37) 

with k — 6. It is well known that with this PSF the operator K in (!36l) is compact 
with infinite dimensional range and therefore K\ the Moore-Penrose inverse of K, is 
unbounded. 

Generalized Tikhonov-Phillips methods with different penalizers where used to 
obtain regularized solutions of the problem 

Kf = g. (38) 

The data g was contaminated with a 1% zero mean Gaussian noise (i.e. standard 
deviation of the order of 1% of ||^|| ). Minimizers of functionals of the form 

J a (f) = \\Kf-g\\ 2 + aW(f) (39) 

were found for different penalizers W(f), where g represents the noisy version of g. In 
all cases the value of the regularization parameter a was approximated by using the 
L-curve method (0, H2|, US])- 



Figures 1(a) and 1(b) show the original image (unknown in real life problems) 
and the blurred noisy image which constitutes the data for the inverse problems, 
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respectively. Figures 1(c) and 1(d) show the reconstructions obtained with the classical 
Tikhonov-Phillips methods of order zero and one, corresponding to W(f) = \\f\\ 2 and 
W(f) = ||V/|| 2 , respectively. 




(a) Original image (unknown). (b) Blurred noisy image (data). 




(c) Tikhonov-Phillips of order (d) Tikhonov-Phillips of order 
zero, W(f) = Il/H 2 . one, W[f) = ||V/|| 2 . 



Figure 1. Original image (a), blurred noisy image (b) and regularized solutions 
obtained with the classical Tikhonov-Phillips methods of order zero (c) and one (d). 



Figures 2(b) and 2(c 



show the reconstructions obtained with a structural 
information penalizer of the form W(f) = \\Lf\\ 2 where the operator L is constructed 
as in Hi 



including the information of the curve 7 depicted in Figure 2(a) where it is 
expected that the original image have steep gradients. The operator L is constructed 
so as to capture this structural prior information. The discretization of L is given by 
J n \\A(x)Vf(x)\\ 2 dx with A(x) = I - (1 + c|| Vj(x) || 2 ) -1 Vj(x) (V7(x)) T , where c is a 
positive constant. In this way, if ||V7(x)|| is large, the functional W(f) penalizes only 
very mildly all intensity changes occurring in the direction of Vj(x) (see [H] for more 
details). 
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(a) The curve 7 providing the (b) Structural penalizer W(f) = 
structural information. ll-^/ll) c = 5. 




(c) Structural penalizer W(f) = 
||£/||, C =20. 



Figure 2. Structural information (a), reconstructed image with structural information 
penalizer and c = 5 (b) and c = 20 (c) 



Figures 3(a) and 3(b) correspond to images reconstructed with hybrid Tikhonov- 
structural penalizers W(f) = |||/|| 2 + |||Afl| 2 > with c = 5 and c = 20, respectively. 

A comparison of the images obtained with the different methods clearly show that 
the choice of the penalizer in Tikhonov-Phillips method can greatly affect the obtained 
approximated solution. In this particular case we observe how the classical order-zero 
method tends to smooth out boundaries and edges and, while the order-one method does 
a better job, the inclusion of the structural information through the operator L results 
in a significant improvement. Although the main objective of this article is theoretical 
in nature, providing sufficient conditions on the model operators and the penalizers 
for the existence, uniqueness and stability of solutions of the corresponding generalized 
Tikhonov-Phillips methods, the previous applications to image restoration were included 
to better emphasize the importance of the adequate choice of the penalizer. 
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(a) (b) 

Figure 3. Recostructed images with hybrid penalizers: W(f) = |||/|| 2 + |||i/|| 2 ; 
c = 5 (a) and c = 20 (b) 

6. Conclusions 

In this article sufficient conditions on the penalizers in generalized Tikhonov-Phillips 
functionals guaranteeing existence, uniqueness and stability of the minimizers where 
found. The particular cases in which the penalizers are given by the bounded variation 
norm, by powers of seminorms and by linear combinations of powers of seminorms 
associated to closed operators, were studied. Several examples were presented and a 
few results on image restoration were shown to illustrate how the choice of the penalizer 
can greatly affect the regularized solutions. 
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